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ABSTRACT 


Direct  iterative  methods  tor  solving  the  linear  system  AU  -  Y 
split  A  into  a  difference  M-N .  By  viewing  N  as  a  weak  multiplica- 
tion  operator, /we  determine  the  convergence  rates  of  block  direct 
iterative  methods  for  solving  the  system  of  equations  that  arises  in 
the  finite  element  approximation  of  an  elliptic  boundary  value 
problem.  JW^lUustrate  the  theory  with  an  analysis  of  second  order 
Dirichlet  problems  in  the  unit  square,  using  Hermite  cubic  finite 
element  spaces.  However,  the  method  of  analysis  extends  to  gen¬ 
eral  elliptic  boundary  value  problems  of  order  2m  on  bounded 
domains  in  d  space  dimensions,  and  to  a  broad  class  of  finite  ele¬ 
ment  spaces.  ^  ‘ 
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Chief,  Technical  Information  Division 
Discrete  approximations  of  linear  elliptic  partial  differential  equations  lead 


to  a  linear  system  of  algebraic  equations 


AU  =  Y, 


(1.1) 


in  which  the  matrix  A  represents  a  discretization  of  the  partial  differential 
operator  and  U  is  a  discrete  approximation  of  the  true  solution.  Typically  this  is 
a  large,  sparse  algebraic  system:  on  a  mesh  of  size  h  in  a  d-dimensional  region. 
U  has  0(h~*)  components,  and  A  has  only  a  few  times  that  many  nonzero  ele¬ 
ments.  The  development  of  computers  made  practical  the  solution  of  such  sys¬ 
tems.  Hardware  limitations  and  a  desire  to  solve  multidimensional  problems, 
together  with  the  size  and  sparseness  of  the  system,  combined  to  stimulate  the 
development  of  direct  iterative  methods  for  solving  (l.l).  Elliptic  difference 
equations,  which  lead  to  big  systems  (1.1)  partly  because  the  standard  finite 
difference  schemes  have  Ofa2)  accuracy,  received  special  attention:  see  [B], 
[22],  [lj.  [12],  [20],  and  [13].  But  the  development  of  finite  element  methods  - 
particularly  higher  order  accurate  methods  on  irregular  meshes  —  and  of  direct 
factorization  methods  suitable  for  finite  element  systems  (1.1)  (see  e.g.  [5],  [24], 
[2],  [19],  [4],  [6],  [17],  [9]),  together  with  the  discovery  of  fast  factorization 
methods  for  nice  elliptic  difference  equations  (see  [15]  for  some  references), 
combined  to  lessen  interest  in  iterative  methods. 

Nevertheless,  iterative  methods  for  finite  element  equations  have  received 
some  attention.  Fix  and  Larsen  [7]  and  Varga  [21]  studied  the  convergence  of 
the  successive  overrelaxation  (SOR)  method,  based  on  point  and  Jb-line  block 
splittings  of  the  finite  element  matrix  A,  for  self-adjoint  elliptic  problems  of 
order  2m.  They  showed  for  such  problems  that  there  are  choices  of  the  relaxa¬ 
tion  parameter  u  for  which  the  spectral  radius  pu  satisfies  the  inequality 


p„«  1  -  A7i  ,  when  u  =  1.  which  is  the  Gauss-Seidel  method,  the  corresponding 
inequality  is  pcs  S1  ■  Kh2m .  Each  inequality  is  what  one  would  expect  for  finite 
difference  approximations.  But  in  neither  instance  could  they  determine  the 
constant  K. 

In  [16]  Rice  experimentally  compared  direct  factorization  methods  to  point 
SOR  methods  for  Hermite  cubic  finite  element  approximations  of  some  second 
order  elliptic  problems.  He  concluded  that  point  SOR  and  Jacobi  conjugate  gra¬ 
dient  iterative  methods  are  more  efficient  than  Gaussian  elimination  when  the 
approximation  is  sufficiently  accurate.  For  the  problems  he  considered, 
"sufficient  accuracy"  is  a  surprisingly  coarse  0.1%. 

A  direct  (or  cyclic)  iterative  scheme  splits  the  matrix  A  into  the  difference 

A  =  M  -  N,  (1.2) 

and  generates  a  sequence  according  to 

MVW  =  NU^-V  +  Y.  (1.3) 

Convergence  of  the  sequence  is  governed  by  the  spectral  radius  p  of 

converges  to  the  solution  of  (1.1)  for  any  iff  p  <  1.  and  smaller  p 
implies  faster  convergence.  To  determine  the  convergence  rate  of  (1.3)  there¬ 
fore  requires  not  only  that  we  establish  estimates  like 

p  »  1  -  Khp , 

but  also  that  we  determine  p  and  K. 

In  [13]  one  of  us  (Parter)  developed  a  general  approach  for  estimating  the 
rates  of  convergence  of  the  classical  Iterative  schemes  -  Jacobi.  Gauss-Seidel, 
and  SOR  -  for  self-adjoint  elliptic  finite  difference  problems.  In  [15]  we 
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simplified  the  presentation,  and  extended  the  method  of  analysis  to  parabolic 
problems  and  to  nonself-adjoint  elliptic  finite  difference  problems.  The  key  to 
the  method  is  that  the  matrix  N  looks  like  a  weak  multiplication  operator:  there 
is  a  function  g  for  which  ( NU,V)  »  {qU ,V).  In  this  work  we  employ  the  same 
basic  approach  to  deal  with  finite  element  equations  arising  from  elliptic  prob¬ 
lems.  even  problems  that  are  not  self-adjoint.  However,  the  analysis  of  (1.3)  for 
finite  element  equations  requires  several  new  ideas. 

The  theory  of  [13]  and  [IS]  asks  that  the  splitting  (1.2)  satisfy  four  basic 
proper  ies.  To  verify  the  third  (A.3  in  this  paper,  A.4  in  [15]).  which  asserts  that 
N  behaves  properly,  can  be  a  little  complicated,  even  in  the  finite  difference 
case.  For  the  finite  element  case  it  appears  to  be  very  difficult.  Part  of  the 
difficulty  stems  from  the  fact  that  finite  element  methods  involve  derivatives  as 
well  as  function  values.  For  example,  in  a  second  order  elliptic  problem  the 
finite  element  method  based  on  tensor  products  of  Hermite  quintic  splines  will 
involve  several  derivatives  beyond  the  first.  These  derivatives  appear  in  the  ele¬ 
ments  of  N.  Nevertheless,  the  finite  element  method  only  yields  Hl  estimates  - 
that  is.  Lz  estimates  on  the  approximate  solution  and  its  first  derivatives.  In  [3] 
Boley  and  Parter  studied  a  finite  element  approximation  of  a  simple  one¬ 
dimensional  problem.  Their  treatment  of  derivative  terms  cannot  be  extended 
to  multidimensional  problems. 

Sections  8  through  8  discuss  the  model  problem  that  seeks  u  satisfying  Dir- 
ichlet  boundary  conditions  and  the  equation 

ha  :=  -[(<xu,)«  +  ( 6u,)„  +  ( buy ),  +  (ciiy),]  +  dxus  +  d^  +  e(0u  =  /  (1.4) 

in  the  unit  square  ft,  with  d0(x,y)  as  0.  The  finite  element  subspaces  5n  are  ten¬ 
sor  products  of  Hermite  cubic  splines.  We  consider  both  Jb-line  iterative 
methods  and  the  point  Gauss-Seidel  method.  In  these  cases  we  find  that  one 
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need  consider  only  the  function  values  (as  in  the  finite  difference  case)  —  that  is. 
we  can  ignore  certain  derivative  terms.  Thus  the  necessary  calculations  are 
similar  to  those  carried  out  in  our  earlier  work  [15].  In  particular,  the  spectral 
radius  pj(k)  of  the  k -line  block  Jacobi  iterative  method  is  given  by 

(1.5) 

asymptotically  as  by  -*  0.  Here  P0  is  the  minimal  eigenvalue  of  the  elliptic  eigen¬ 
value  problem 


L<p  =  \c  (z  ,y)<p  in  0.  <p  =  0  on  90.  (1.6) 

Because  this  iterative  scheme  satisfies  block  property  A.  the  corresponding 
spectral  radius  pu(fc)  for  the  successive  overrelaxation  (SOR)  fc-line  method  with 
relaxation  parameter  u  is  fixed  by  the  equation 

(/>«  +  u  -  1)*  =  uzpjpu. 


Thus  the  Jacobi  spectral  radius  determines  the  smallest  SOR  spectral  radius  p*. 
its  corresponding  .  and  the  Gauss-Seidel  spectral  radius  pcs'- 


Pcs  P% 


ub  :  = 


2 

1  +•  Vl  - p } 


pb  :=  ub  -  1 


(1.7) 


(see  [l],  [20,  chapter  4],  [23]).  It  is  interesting  to  compare  the  estimate  (1.5) 
with  our  earlier  estimates  in  [12],  [13],  and  [15]  for  a  (particular)  finite 
difference  approximation.  In  that  case  we  have 
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pAk)  *  i  -  Yv^y2 


(1-8) 


viith  the  same  r0! 

While  the  detailed  analysis  leading  to  these  results  is  carried  out  only  for 
the  model  problem,  it  is  clear  that  these  ideas  apply  under  much  more  general 
circumstances.  For  example,  this  analysis  is  easily  extended  to  those  cases 
where  the  finite  element  subspaces  are  "nodal”  finite  element  subspaces  (see 
[18]  or  [19])  and  the  block  splitting  is  based  on  a  reasonable  geometric  choice  of 
blocks.  The  region  n  may  be  any  smooth  region  in  R1 ,  while  the  elliptic  operator 
may  be  any  strongly  elliptic  operator  of  order  2m..  In  section  9  we  comment 
further  on  the  generality  of  the  analysis  contained  herein. 

Sections  2  through  5  are  concerned  with  the  general  approach  and  develop 
the  basic  theory.  In  section  2  we  describe  the  general  class  of  finite  element 
approximations  to  elliptic  boundary  value  problems  that  can  be  written  in  a 
weeds  form.  We  also  describe  the  related  algebraic  problems  (1.1).  In  section  3 
we  recall  the  classical  iterative  methods.  In  section  4  we  extend  our  earlier 
thoretical  work  for  finite  difference  approximations  to  the  finite  element  setting. 
The  basic  hypothesis  is  assumption  A.  3. 

There  are  a  constant  g0  and  a  function  q  e  Cl(H)  with 

g(x)  fc  ?0  >  0  (z  e  H), 

and  a  function  r)(t ),  defined  for  f  i  1  and  satisfying 

r)[t)  -  0  as  f  -•  «, 

such  that  for  every  u  and  v  in  S„  we  have 
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where 


hZm  V'N  0  =  J quO  dx  +  en(u ,v) , 


| c„(ia.x»)  |  £  i?(n)[||u||f  +  Ml?  +  Hull,  +  || v Hi]. 

While  this  may  appear  to  be  an  unusual  condition,  we  believe  that  it  is 
satisfied  by  most  natural  splittings.  The  basis  for  this  belief  for  finite  differences 
is  described  in  [15,  section  9].  For  finite  elements,  our  belief  is  grounded  in  that 
discussion  and  the  fact  that  we  can  ignore  derivative  terms  to  estimate  q .  As  we 
shall  see  later,  the  exact  form  of  the  bounds  on  the  error  term  eB(u,v)  can  be 
exploited  to  give  some  interesting  results. 

In  section  5  a  new  convergence  theorem  is  proven.  Loosely  speaking,  if  (i) 
the  subspaces  Sn  satisfy  certain  inverse  inequalities,  (ii)  there  is  a  particular 
bound  on  en,  and  (ill)  there  is  an  eigenpair  (X,  D)  associated  with  the  spectral 
radius p  so  that  |X|  =  p  and 


Re  ( U'NU)  i  0,  (1.9) 

then  for  small  h  the  method  is  convergent  and  we  can  estimate  the  asymptotic 
form  of  p.  While  it  is  not  at  all  obvious  that  one  should  expect  (1.9)  to  hold  in  the 
generality  of  the  finite  element  equations  and  for  nonself-adjoint  problems, 
nevertheless  condition  (1.9)  is  always  true  for  block  Jacobi  schemes  that  have 
block  property  A. 

Finally,  in  Section  9  we  discuss  the  significance  of  the  results. 

For  the  reader's  convenience,  we  collect  some  notation  in  the  rest  of  this 
section. 

Let  0  be  a  bouz..  ad  dam'  in  R?.  If  u  and  v  are  in  L*(Q),  their  inner 


product  is 
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(u,v)Q  :=  fau(x)v{x)dx. 


The  corresponding  norm  is  denoted  by 

IMIoio  :=  V(u,u)n. 


Customarily  we  write  {u  ,v)  and  ||u|!0  when  the  set  0  is  clear  from  the  context. 

Let  u:Q-»R.  We  denote  the  partial  derivative  of  u  with  respect  to  by 
Dtu  :=  .  Conventionally,  if  a  =  (a^  ae.  •  •  ■  ,  ad)  is  a  d-tuple  of  nonnegative 

OZi 

integers,  then  we  set  | a |  :=  a1+a2+  •  ■  ■  +0*.  and  by  Da u  we  mean 
D?1  •  •  D?du. 

By  Hm{ 0)  we  mean  the  set  of  functions  u  that  together  with  all  their  partial 
derivatives  up  to  order  m  are  in  Lz{ H).  Symbolically,  we  have 

tfm(n)  :=  \u  eLz(Q):Dau  elz(  0)  for  0  <  |a|«mj. 

Hm( fl)  is  a  Hilbert  space  with  norm  defined  by 

llulft:*  £  {D*u.D*u). 

|a|«nv 

It  will  be  convenient  to  define  the  seminorms  |*|j  on  Hm{ 0)  for  Os  j  s  m 
by 


!«!/:=  £  (D*u.D*u).  (1.10) 

1*1*/ 

Observe  that  | •  |o  is  the  Lz  norm  ||-||o.  and  ||u||£i  *  2  \u\f- 

0 *J*m 


1 
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Throughout  the  text,  C  and  K  denote  generic  constants.  Constants  of  more 
than  local  importance  are  numbered. 

We  are  indebted  to  Carl  deBoor  and  Louis  Nirenberg  for  useful  discussions. 


J 
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2.  The  problem. 

Let  0  be  a  smooth,  bounded  domain  in  R*.  and  let  L  be  the  linear  elliptic 
operator  of  order  2m  defined  by 

Lu-  £  (-l)|a|^a(aM(z)Z?»U).  (2.1) 

lal.ll!  *m 

We  consider  the  boundary  value  problem 

Lu  =  /  in  (1,  bju  =  0  on  3Q  (2.2) 

where  the  boundary  operators  bj  are  linear  and  independent.  We  assume  that 
the  problem  (2.2)  is  equivalent  to  the  following  "weak”  formulation:  there  is  a 
subspace  Hm  of  Hm{ Q)  and  we  seek  u  e  such  that 

B{u,v)  -  F(v)  for  all  u  e  ftm,  (2.3) 


where 


B(u,v)  :=  fnb(u,v)dx 


(2.4a) 


with 


6(u.v)  :=  £  aclf(,z)DfuDa€ .  (2.4b) 

|a|.|0|«m 


and 


:=  fa/(x)v(z)dz. 


(24c) 


Note  that  this  formulation  of  the  problem  is  in  effect  a  statement  about  the 
nature  of  the  boundary  conditions  of  (2.2). 
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We  also  assume  that  the  form  B( u,v)  is  continuous  and  coercive  on  . 
That  is,  we  assume  there  are  positive  constants  Ki  and  Kq  such  that  for  all  u  and 
v  in  H m  we  have 


\B{u,v)  \  £  /fjllujlmlMU  (continuity). 
Re  B(u,u)  ^  KvWv-Wm  (coercivity). 


(2.5) 


A  simple  computation  shows  for  any  u  e  Hm  that 

| Im  B (u ,u )  |  ^  -rr~  ! He  B(u,u)  | . 
no 

This  inequality  is  called  the  angle-bounded  property  of  B.  A  finite  element 
approach  to  the  numerical  solution  of  this  problem  is  given  by  a  sequence  {Sn| 
of  finite-dimensional  subspaces  of  satisfying 

dim(Sn)  =  n,  (2.6) 

and  the  solutionis  e  Sn  of  the  finite-dimensional  discrete  problem 

B{u n,vn)  =  F(vn)  for  all  vn  £  5n.  (2.7) 

With  each  5„  we  associate  a  basis  \<pj and  a  positive  constant  h  -h*.  the 
"mesh  size";  we  suppose  that  h„  -»  0  as  n  -*  ». 

The  problem  (2.7)  is  brought  into  computable  form  by  setting 

■- B{<pj,<pi)  (1  <i.j*n).  (2.8) 


Problem  (2.7)  now  takes  the  form:  find 
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Un  :=  £  Ujtpj  in  5„. 
i- 1 


where  the  vector 


&n:=(£/i.  •  ■  •  ,  C/n)‘ 


corresponding  to  the  function  i ^  satisfies 


=  fnf  ifiidx  =  F(<fi)  =:  Fi  (lsisn). 


Thus,  if  >1  is  the  nxn  matrix  and  is  the  n -vector 


A  :=  (Otj). 


F:=  (A.  ■  ,Fn)1. 


(2.9a) 


(2.9b) 


(2.9c) 


(2.10a) 


(2.10b) 


1 


then  (2.7)  reduces  to  the  problem  of  finding  D  that  solves 


AU-  F. 


(2.10c) 


The  matrix  A  is  called  the  problem  matrix.  Another  matrix  of  interest  is 
the  mass  matrix  Q  given  by 


Qi.i  :*  fa  ?}<Pi  dx. 


(2.11) 


If  f/and  V  are  the  vectors  associated  with  functions  u  and  v  in  S-,  we  have 


P*qD  -  fn  ud  dx , 


(2.12) 
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where 

V  =  (Pi.  •  •  •  .  Fn).  (2.13) 

The  coercivity  condition  (2.5b)  implies  that 

Re  (D*A0)  K0U*QU.  (2.14) 

Because  Q  is  a  positive  definite  matrix,  (2.14)  implies  that  the  system  (2.10c) 
has  a  unique  solution  Un . 

We  consider  a  direct  iterative  method  for  the  computation  of  Un.  and  hence 
of  Ujj.  We  write 


A  =  U  -  N,  (2.15) 

where  M  is  nonsingular  and,  in  some  sense,  it  is  easy  to  solve  problems  of  the 
form  MU=G.  Let  a  first  guess  be  chosen.  Succeeding  iterates  are  given  by 

+  F.  (2.16) 


It  is  well  known  that  this  procedure  is  convergent  for  any  initial  guess  if  and 
only  if  the  spectral  radius 


p  :=  max  :  X  is  an  eigenvalue  of  M~lN j 
=  max  j  |  A.  |  :  Aet{\M-N)  =  Oj 


(2.17) 


of  M~lN  satisfies  p  <  1. 

Our  problem  is  the  following.  Imagine  a  sequence  |5R  j  of  subspaces  and  the 


corresponding  matrix  problems 
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AnUn=  Fn.  (2.18) 

where  we  have  now  used  subscripts  n  on  the  problem  matrices  An  and  the 
moment  vectors  fn  to  emphasize  this  sequence.  Suppose  the  splittings 
An  »  Mn-Nn  of  (2.15)  are  chosen  in  some  regular  fashion.  V.'e  seek  to  determine 
the  asymptotic  behavior  of  the  corresponding  spectral  radius  pn  as  r>  -►  ». 
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3.  The  classical  iterative  methods. 

Suppose  A  is  an  nxn  matrix.  The  block  structure  of  a  direct  iterative 
scheme  for  the  problem 


AX  =  Y  (3.1) 

is  completely  determined  by  a  block  partition  of  the  n -vector  X.  Suppose  every 
vector  X  is  decomposed  into  subvectors 

x  =  (xlt  x2,  •  •  ■ .  xry 

and  each  Xj  is  itself  an  -vector.  This  partition  of  X  induces  a  block  partition 
A  -  [At  j]  in  which  each  Aij  is  ann^XTij  matrix.  The  corresponding  block  Jacobi 
iterative  scheme  is 

+  Yt.  (3.2) 

set 

In  terms  of  (2.16),  M  is  the  block  diagonal  matrix  M  :=  diag[4.<]-  The 
corresponding  Gauss-Seidel  scheme  is 


4.i*t(v)  =  -'ElAiAXM-'£Ai.,Xy-')  +  n.  (3.3) 

s<t  s>« 

while  the  SOR  scheme  with  relaxation  parameter  u  is 

AnX +  uY<  +  d  -  u)Ai.ixtv-'\  (3.4) 

s<t  «>t 


We  will  be  interested  in  specific  block  structures  that  arise  in  a  natural 


geometric  way. 
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4.  A  general  approach. 

Our  analysis  of  the  iterative  scheme  (2  16)  is  an  extension  of  the  approach 
taken  in  [13]  and  [15].  We  make  four  basic  assumptions. 

A.  1  p  <  1,  so  the  iterative  scheme  is  convergent. 

A.2  p  is  an  eigenvalue  of  U~lN:  there  is  a  mesh  vector  V  *  0  such  that 

pUV  -  N  V. 

A. 3  There  are  a  constant  g0  and  a  function  q  £  C'((l)  with 

q{x)  is  g0  >  0  (z  e  Q), 

and  a  function  77(f).  defined  for  t  &  1  and  satisfying 

77(f)  -*  0  as  t  -»  », 

such  that  for  every  u  and  v  in  Sn  we  have 

hZm  V' N  U  =  fquOdx  +  en(u,v), 

where 

|en(u.u)|  &  rj(n)[i|u||?  +  || v ||f  +  ||u||,  +  ||v|tl]. 

A.4  Let  q  be  the  function  of  A. 3.  The  eigenvalue  problem  that  seeks  A  e  C  and 
p  e  f}m  to  satisfy 


=  \f  qpv dx  for  all  ve#"1 


(41) 
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has  a  minimal  eigenvalue 


A«n  =  Ao  +  iT. 

By  minimal  we  mean  that  for  any  eigenvalue  X  it  is  true  that 
0  <  Ao  <  Re  X,  and  that  if  Re  X  =  Ao  then  j  X  j  fc  J  Am  j . 

Note  that  if  A*,  is  a  minimal  eigenvalue  then  so  is  Am;  if  T  =  0.  then 

A„,  =  Ao  s  [ X  |  for  any  eigenvalue  X. 

Observe  also  that  the  eigenvalue  problem  (4.1)  is  equivalent  to  the  problem 
L<p  =  \q<fi  in  0,  6^  =  0  on  30  (Os)  sm-l). 

Condition  A.4  actually  asserts  that  there  is  at  least  one  eigenvalue.  In  the 
self-adjoint  case,  and  in  the  case  of  a  second  order  operator  with  Dirichlet  boun¬ 
dary  conditions,  A.4  is  always  valid  and  A™  =  A o-  We  surmise  that  A.4  is  always 
true,  but  we  prefer  to  make  the  assumption  explicit.  Conditions  A.l  and  A.2  are 
readily  verified  for  self-adjoint  problems  for  which  the  splitting  (2.15)  satisfies 
block  property  A;  see  e.g.  [l],  [13].  For  standard  finite  difference  approxima¬ 
tions  of  general  second  order  Dirichlet  problems,  A.l  and  A.2  follow  from  the 
Perron-Frobenius  theory  of  positive  matrices:  see  [20]  and  [15]. 

While  one  should  write  IAn,  Nn,  pn,  and  tin,  we  will  usually  drop  the  subscript 
n  when  its  use  is  not  essential  for  the  clarity  of  the  discussion. 

Let  X  *  0  be  an  eigenvalue  of  the  iterative  scheme  (2.16),  and  let  *  0  be 
an  associated  eigenvector,  so  that 


\MW=NW. 


(4.2) 
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Subtract  \N  V  from  both  sides  and  divide  by  X  to  see  that 

AW  =  1-^-—  NW.  (4.3) 

A 


Now  set 


<44> 


Then  the  eigenvalue  problem  (4.3)  can  be  restated  in  the  equivalent  forms 


A  W=fj.(hZm  N)W, 

B[w,v)  =  iiV\hZmN)ft  for  all v  e  Sn. 


(4.5) 


A  basic  result  about  this  eigenvalue  problem  is 
Lemma  4.1.  Suppose  A.3-A.4  hold. 

(a)  Let  IaAiI  he  a  bounded  sequence  of  eigenvalues  of  (4.5).  so  that  there  is  a 
constant  C  >  0  for  which 

\(bx  I  £  C. 


Then  the  limit 


(Am  .=  lim„'-„  ('-n' 

of  every  convergent  subsequence  is  an  eigenvalue  of  (4.1). 

(b)  Let  A  be  an  eigenvalue  of  (4.1),  and  fix  6  >  0  Then  there  is  an  n,  so  that  for 
each  n  n,  there  is  an  eigenvalue  (Xn  of  (4.5)  satisfying  |A  -  /t*n  |  as  d. 

Proof.  This  result  is  essentially  contained  in  the  general  theory  for  the 


1 
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spectral  approximation  of  compact  operators  (see  [il]).  However,  for  the  sake 
of  completeness,  and  to  indicate  an  approach  that  applies  in  more  general  situa¬ 
tions  (see  [14]).  we  give  the  proof  in  the  appendix;  (a)  is  Lemma  A.1  and  (b)  is 
Theorem  A.  4. 

Theorem  4.2.  Suppose  A.3-A.4  hold.  Then 


p  =  pn  &  1  -  AoA2"4  +  o(hZm).  (4.6) 

Proof.  Lemma  4.1b  implies  that  there  is  a  sequence  of  eigenvalues  of  prob¬ 
lems  (4.1),  which  we  denote  by  that  converges  to  A**,.  Thus  Re  ^  -»  Aq  and 

Re(l  1. 


whence 


^  ;=  MaO 


1 

1  + 


is  a  well  defined  eigenvalue  of  (4.2),  j  X  |  <  1,  and 


=  1  -AcAn^-  +  o(/i^-)- 

Therefore  the  theorem  follows  from  the  definition  of  p. 

Theorem  4.3.  Suppose  A.1-A.4  hold.  Then 

p  =pn  =  1  -A0AnZm  +  (4.7) 


Proof.  Set 


M  :  = 


1  -P 

ph8m 


(48) 


From  A.l  and  Theorem  4.2  we  then  see  that 


0  <  £  s  Ac  +  o(l).  (4.9) 

More  Important,  A.2  implies  that  /T  is  an  eigenvalue  of  (4.5).  From  Lemma  4.1 
and  the  definition  of  Am  we  then  have 

A<>+o(l)  =  Re£  =  aT^Ao+o(1). 

Therefore  ju  -*  Ao  as  n  -»  »,  and  (4.7)  holds. 

Remark.  Because  ju  is  an  eigenvalue  of  (4.5),  Lemma  4.1  shows  that  Ao  is 
itself  an  eigenvalue.  Hence  Am  =  Ao  is  real  when  A.1-A.4  hold. 

Theorem  4.2  and  A.2  suggest  the  following  condition. 

B.2  There  is  a  constant  C0  for  which,  for  every  n,  there  is  an  eigenvalue  \n 
that  satisfies 

I  1  -  pn  and  1  I  *  Co-  (410) 

In  fact,  this  condition  can  replace  both  A.l  and  A.2. 

Theorem  4.4.  Suppose  B.2.  A.3,  and  A.4  hold.  Then  the  method  is  convergent 

and 


p  =  1  -  Ao/l*"  +  o  (A*"). 
Proof.  Let  An  =  a„  +  ibn .  Then  (4.10)  implies 


(l-an)*  +  b**h*’"C§. 


(411) 


t--v- 
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Set  ' 


—  1  "* 
Mn:"  Xn/ln8"* 


(4.12) 


Then  /2n  is  an  eigenvalue  of  (4.5),  and  using  (4.10)  we  have  ]/2n  |  s  2C0  for  V 
sufficiently  small.  Hence  by  Lemma  4.1  there  is  an  eigenvalue  Ai  of  (4.1)  and  a 
subsequence  in')  such  that  -*  Ax  as  n'  -*  «.  Let 


A,  =  c  +  id.  (4.13) 

Convergence  of  the  subsequence  and  (4.12)  together  imply  that 

1  -  V  =  A1An  A*.m  +  o(A*"). 


Thus 


K"  *  On-  +  ibn-  *  1  -  AiXn-^  +  0  (*nZ,n) 


=  1  -  (a„.c  -  6n.d)A^n  -  i(an-ti  +  bn  c)h*r*  +  o  (A^»). 


(4.14) 


From  (4.14)  and  the  fact  that 


«*„.  =  1  +  0(h$*).  bn.  =  0(h *!*) 


we  deduce  that 


<V  =  1  -  On-cAn8"*  +  0  (A^),  |  V  |«  =  1  -  Zch*!"  4  o  (A^»). 


Therefore 


P*  =  |A»*I  3  1  -chjff*  +  o(A^). 
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By  definition  of  Ac,  0  <  c  =  Re  Alt  and  therefore  Theorem  4.2  implies  that 
c  =  Ac  This  proves  the  theorem. 
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5.  A  convergence  theorem. 

In  earlier  work  [12],  [13],  and  [15]  for  finite  difference  equations,  am  analo¬ 
gue  of  Theorem  4.3  established  the  asymptotic  behavior  of  p.  In  this  section  we 
use  Theorem  4.4  to  obtain  a  new  convergence  theorem  for  finite  element 
methods  and  splittings  (2.15)  that  satisfy  reasonable  conditions.  A  remarkable 
feature  of  this  proof  is  that  we  require  no  positivity,  positive  definiteness,  or 
self-adjointness  of  the  matrices  involved.  Therefore  the  theorem  is  particularly 
useful  for  nonself-adjoint  problems  and  finite  element  discretizations.  Moreover, 
the  theorem  cam.  be  recast  to  provide  new  results  for  finite  difference  approxi¬ 
mations. 

Theorem  5.1.  Consider  the  splitting  (2.15)  and  the  iterative  scheme  (2.16). 
Suppose  A.3  holds  and 

|cn(-u,u)|  sS  Aa[A||ui!0|| Vu||0  +  At2|| Vrt |i|].  (5.1) 

|  Im  ( U*hZm  N  0)  |  =  1  U'h.2"  < N  ~  ^  U\  *  AaMliulfl  +  |e»(u.u)|).  (5.2) 

We  also  assume  that  certain  "inverse  inequalities”  are  satisfied:  there  are  con¬ 
stants  Cj  such  that 


CjA*  |  u  \j  s  ]  u  |0  (j  =  0,  1,  2,  •  ■  ■  ,  m),  (5.3) 

where  \u\t  is  the  seminorm  of  u  defined  by  (1.10).  Finally,  we  assume  there  is 
an  elgenpair  (A.u)  for  which 

I \\=P.  |ML  =  1.  i:c(D*AfD)arO.  •  (5.4) 


•‘hen  the  iterative  scheme  (2.18)  is  convergent  and 
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p  =  1  -Aoh2m  +  o{hZm). 


(5.5) 


Remarks.  If  the  inverse  inequalities  (5.3)  hold,  then  Landau's  inequality 
implies  that  there  is  a  constant  d0  such  that 

*mIML  ffolMlo-  (5.6) 

This  inverse  inequality  is  valid  for  many  of  the  usual  finite  element  spaces  Sn  : 
see  [6].  Condition  (5.4)  holds  when  the  splitting  (2.15)  is  a  block  Jacobi  splitting 
that  satisfies  block  property  A.  This  is  so  because  block  property  A  implies  that 
—A  is  an  eigenvalue  of  the  iterative  method  whenever  A  is:  see  [23.  chapter  5]. 
The  estimate  (5.1)  is  a  special  form  of  the  basic  estimate  of  A.3.  As  we  will  see  in 
section  7,  precisely  this  estimate  is  satisfied  in  our  model  problem.  Further,  the 
derivation  of  this  estimate  and  the  arguments  of  [15,  section  9]  suggest  that  this 
is  just  the  form  to  be  expected.  The  estimate  (5.2)  arises  because  the  antisym¬ 
metric  part  of  N  is  usually  related  to  the  lower  order  terms  of  the  elliptic  opera¬ 
tor  L. 

For  the  proof  we  need  three  lemmas. 

Lemma  5.2.  Let  >  0  be  a  fixed  (small)  constant.  Then  there  is  a  constant 
Cflo,  depending  on  -d0  and  m,  and  a  constant  h{m),  such  that  for  every 
u  e  Hm( Q)  and  h  s  h(m)  we  have 

A8!|7u|||  tf0||u|||  +  /i2"*C„0|  u  I*  .  (5.7a) 

hz\\Vu\\$*  0ol|u||f  +  h^C^WuWl .  (5.7b) 
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Proof.  We  ftrst  derive  a  special  form  of  Landau’s  inequality:  for  every  i5  >  0 
there  are  constants  D*(k)  and  h,  depending  only  on  and  k,  such  that  for  every 
u  €  Hk*}  and  h  <  A 


l«l*  *=  -^rN!!o  +  D4(k)hz\u  ||+i.  (5.8) 

The  proof  of  (5.8)  follows  by  induction.  The  usual  form  of  Landau’s  inequality 
(see  [10])  is:  there  are  constants  c  and  a0,  depending  only  on  Q.  so  that  for 
every  positive  a  less  than  a0 

|  u  |/+j  s;  c(a|  u  |/+g  +  |  u \f).  (5.9) 

Hence  (5.8)  is  true  for  k  -  1.  Assume  (5.8)  holds  for  k  =  1,  2.  3,  •  •  •  .  j  ■  Let 

a!  :=  c  max  (2,  ZD^{k)  :  1  s;  *  j  (5.10a) 

and  set 

a  :=  axhz.  (5.10b) 

For  some  positive  hj  it  is  true  that  o  s;  a0  whenever  h  <  h.j.  Then  (5.9)  yields 

l“lj*i  s  c  {axhz  |  u  |/+z  +  t  ^  !/)• 

Using  the  inductive  assumption  we  have 

l« \f*i  *  c(«i^2!  u  \f*e  +  +  D^{j)hz\u  !/♦,]). 


That  is, 
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But  cDj(j )/  a,  £  1/2  and  c  /  at  «s  1/  2  by  (5. 10a).  and  so 
\u  |/+1  ss  2c«ih2|  u  |jva  + 

Hence  we  have  established  (5.8)  with  D${j  + 1)  =  2c  c^.  For  m  =  1  the  inequality 
(5.7)  is  trivially  true.  For  m  =  2,  the  inequality  (5.7)  follows  from  (5.8)  with 
k  =  1.  We  proceed  by  induction.  Suppose  (5.7)  is  true  for  m  -  1,  2,  ■  ,  k 

Then  for  small  positive  tS  and  for  h  <  hj  (tf)  we  have 

hz\u\l*z  C^hZk\u\l  +  tfiiujlo2.  (5.11) 


Let 


:  = 


i? 

2  C,(fc) 


t? 

C5(fc)  ' 


(5.12) 


then  (5.11)  and  (5.8)  with  t?  =  together  yield 


h*\utf*Cdk)K»{D*lH'\u\Ux  + 


l^iio3)  +  tfiiujlJ 


=  |u!|+1+  ^-||u!!0a+  . 

Setting  Cij(A;  +  l)  :=  C^{k)D^  [k)  completes  the  proof  of  the  lemma. 

Corollary.  Assume  that  (5.1).  (5.2).  and  (5.3)  hold.  Then  there  is  a  constant 
Kt  so  that  for  small  h  and  any  u  e  Sn  we  have 


|Im  (U*h2mNLf)\  <,  K^\u\\l 


(5.13) 


Furthermore,  for  any  nonzero  u  e  Sn  set 


a0  :=  a0(u)  ;  = 


|en(^,u)  I 

IMio 


*  :=  :*  min  (*J,  i?2|. 


Assume  that  a0  *  0  and  set 


*(a0)  :  = 


2C-  , 


Then  for  small  enough  h  (5.3)  implies  that 


c*,hZm\u  |z  <;  ||itj||sfe(izc)hZm||ui!|l 


Thus  if  Un  z  Sn  satisfies 


l«nllrn  =  1  and 


then 


o^u*)  -*  0  as  n  -*  ». 


Proof.  Estimate  (5.13)  follows  from  (5.1).  (5.2),  (5.3),  and  (5.7a). 


(5.14a) 


(5.14b) 


(5.14c) 


(5.15) 


(5.16) 


(5.17) 

The  lower 


bound  of  (5.15)  is  a  restatement  of  (5.3).  From  (5.1)  and  (5.14a)  we  have 
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a0IM|£  s£  Kz{ tfl|uj||  +  (1  +  -^-)h*\u  |f]. 

Using  Lemma  5.2  we  now  deduce  that 

Ooliul!l  s  +  T?o  +  +  C.J0(1  +  -£-)hZm||u||&]. 


Our  choice  of  and  i?0  implies  that 


Kz(&  +  i5o  +  ~^~)  ^  ac/  2. 

Thus  j| u |||  s  A: (c0)/iSm|iu!j^,  whence  (5.15)  and  (5.17)  follow 

For  the  rest  of  this  section  we  assume  that  (5.1).  (5.2),  and  (5.3)  hold. 

Leuha  5.3.  Let  (A,u)  be  the  eigenpair  of  (5.4).  Then  there  is  a  constant  K0 
such  that 


\tj*NU\-)t  K5.  (5.18) 

Proof.  From  A IA  U  =  NU  it  follows  that 

_  U\NU  _  u'Nd  f5 19x 

U‘M  U  U'A  U  +  U'N  U 

Evidently  \VnD\  *  0,  because  p  *  0.  Furthermore,  the  denominator  is  not 
zero  because 

Re  {U'Alf)  =  Re  B(u,u)  *  K0\\u\&  =  A'0  >  0 


and  u  has  been  chosen  so  that  Re  ( D'N  D)  2  0.  From  (5. 19)  it  follows  that 


Now  (5.18)  must  hold,  for  otherwise 


\jf_AU_ 

U'NU 


which  would  violate  Theorem  4.2. 

Let  (A,u)  be  the  eigenpair  of  (5.4).  We  write 

U'h2m  N  U  =  g  +  tx  +  if0,  (5.20a) 


where 


g  :=  fq  \  u\zdx 


(5.20b) 


and  f  i  and  f0  are  real. 

Lemma  5.4.  There  are  constants  h0,  yt,  and  y2  >  0  so  that  for  0  <  h  <  h0  we 

have 

y2q  2:  q  +  t !  =  Re  {U*h?mNl?)  *  yv?  ss  r l^oll^llo*  (521) 

Proof.  Using  (5.1)  we  obtain 

\en{u.u)\*Kt[±-\\u\\S  +  \h*\u\*l 


This  inequality  and  (5.3).  (5.4),  and  (5.7)  together  imply  that  there  is  a  constant 
k'  tor  which 
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\tt\*  |e„(i*.u)|  *  Ka[-^\\u\\S  +  ^-C||u|||]  =:  fc-||u||0* 


(j  =  0.  1).  (5.22) 


This  establishes  the  upper  bound  of  (5.21)  with,  say.  y2  :=  1+fcV  g0. 

We  now  turn  to  the  lower  bound.  If  the  lemma  fails,  then  there  is  a  subse¬ 
quence  }n'i  for  which  (Xn'-UnO  satisfies  (5.4)  and 


^w,8m(?n'  4  t i,n‘) 


(5.23) 


It  follows  from  (5.6)  that  llullm  =  1*  Hence  h^Zm<J  i  q 0/ C* ,  and 

so  the  numerator  of  (5.23),  which  Is  equal  to  Re  [Un-Nn-Un-),  converges  to  0. 
Lemma  5.3  then  shows  that  1 10|  =  |  lm  ( Un’Nn'Un‘)  I  ^  Kz/2.  This  last  ine¬ 
quality  reads 


(5.24) 

We  consider  two  cases.  In  the  first,  h^Zm||un.|lo  "*  “■  But  ttien  (517)  implies 

that 


JiiiL  *  1  _  o, 

?»•  <7olK*llo 

which  contradicts  (5.23).  In  the  second,  there  is  some  constant  C  so  that 
IIur'II#  ^  Ch#*.  But  now  (5.24)  and  (5.13)  yield 


which  is  Impossible. 
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Let  us  now  compute 


x  +  iy 


&AU 

VnD*  ' 


Let 


d* AU  =  a(l  +  icr),  a>K0, 


where  |a|  is  bounded  because  B(u. v)  is  angle  bounded. 
Then 


x 


=  h2ma 


tj  +•  t\  +  ffto 

(q  +  *i)*+7|  ' 


v 


=  h2ma 


+  *i)  ~  *0 

(?  +  fi)8  +  to8  ' 


Proof  of  the  Theorem.  Using  (5.2)  and  (5.22),  we  deduce  that 

l*ol 


Hence 


x  fc  hZma 


7\ q  - 

(q  +  t  + 


>  0. 


Convergence  follows  from  these  inequalities  and  the  fact  that 


X 


1 

1  +  *  +  iy 


(5.25) 


(5.26a) 


(5.28b) 


(5.26c) 


(5.27) 


k 
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Moreover,  Theorem  4.2  implies  that 

Therefore  there  is  a  constant  C  so  that 

lil  +  2i+*!  +  y!  -  Ch2m . 

Because  x  is  positive  and  2x  +  x2  +  y2  <  Ch2m ,  we  get 

0  <  2  <  Ch2m /  2.  (5.28) 

From  (5.21),  (5.26b),  and  (5.27)  we  see  that  (5.28)  implies  that  there  is  a  con¬ 
stant  C  for  which  f  +  f1  >  C.  Then  (5.26c)  shows  that  |  y  |  s  ChZm .  Thus  there 
is  a  constant  C0  so  that 

l1  ~  xll  =  l  zz  +  y*  *  c 
h 4m  h4m  (1  +•  x)2  +  y 2 


But  this  means  that  B.2  holds;  now  Theorem  4.4  implies  (5.5). 
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6.  The  model  problem:  description. 

The  basic  ideas  are  clearest  in  this  simple,  but  relatively  rich,  setting.  Let 
fl  be  the  open  unit  square 

Q  :=  J(x,y)  €  R8  :  0  <  x,  y  <  1{. 

Consider  the  Dirichlet  problem 

Lu  -  f  for  all  [x  ,y )  £  Cl,  (6.1) 

u  =  0  for  all  (z  :y)  e  3Q.  (6.2) 

Here  L  is  the  second  order  uniformly  elliptic  operator  with  smooth  coefficients 
given  by 

Lu  :=  -[(au*)*  +  (feu^y  +  {bUy)T  +•  (cuy)a]  +  +  dz Uy  +  d0u  (6.3) 


where 


a(r,y)sa0>0 


(6.4a) 


b2(x,y)  -  a (x,y)c(x,y)  £  -  a0  <  0 


(6.4b) 


d0(z,y)fcO.  (6.4c) 

The  inequalities  (8.4)  assert  that  L  is  a  uniformly  elliptic  operator. 


Set 
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b(u,v)  :=  aiLgUg  +  (bu^i 7y  +  bUyVt)  +  cUyVy  +  (d^Ug  +  dzUy  +  d0u)f> .( 8.5a) 

and 


B(u,v)  :=  J fab(u,v)dz  dy.  (6.5b) 

As  in  section  2,  we  assume  in  addition  to  (6.4)  that  there  is  a  constant  K0  >  0 
such  that  for  all  u  6  Hq  (Q)  we  have 

Re  B(u.u)  Afolittll?.  (6.6) 

Under  these  circumstances,  the  boundary  value  problem  (6.1),  (6.2)  is 
equivalent  to  the  weak  form  that  seeks  u  e  Ho  (0)  for  which 

B{u.v)  =  f  faf  (z.y)v[x,y)dx  dy  =:  F(v)  for  all  v  e  H&  (d).  (6.7) 

We  now  take  up  the  finite  element  solution  of  this  problem.  Let  Pt  >2  and 
Py  at  2  be  integers,  and  set 


Ax  :  = 


P,  +  1 


Ay  :  = 


Py  +  1 


r:=4S- 


Az 


(6.8) 


For  any  function  G{x,y )  defined  on  0  we  write 


Gi,}  :=  G(tAx,;Ay). 


(6.9) 


The  finite  element  space  Sn  is  the  space  of  tensor  products  of  Hermits  cubic 
splines  based  on  this  grid.  Let 


Zt  :=  iAx  (i  =  0.  !.  2,  ■  .  Pg  + 1). 


(6.10a) 


L 
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y}  :=;Ay  o  =  o.  1.  2,  •  •  •  .  Py  +  l).  (8  10b) 

For  each  pair  (t,j),  0iisPi,0s;sP,.  define 

Sij  ;=  Kar.y)  art  «  x  s  xivl,  y^y  ■&  y;<.,j.  (6.11) 

Hence  the  comers  of  the  rectangle  etj  are  the  points  (z^  ,y;)  —  the  lower  left 
corner  ~  («t+i.y>).  (zt+i.y>*i).  and  (z.  ,yjM).  as  in  Figure  1. 

Figure  1.  The  element  eii; . 

The  restriction  of  any  function  u  £  ?„  to  et,j-  is  a  polynomial  of  degree  three  in 
each  variable  z  and  y ,  given  by 

v{x.y)  =  Va_tlxayii  for  ail  (z,y)  e  eifi.  (6.12) 

o 

Thus  v  is  determined  in  et  J-  by  the  16  parameters 

+*»{>  \{vz)i*-l.j+p\>  i  (vsy) \H,  i*p\'  (6.13) 

with  l  and p  running  over  the  set  {0,  lj. 

Because  we  have  been  discussing  the  restriction  of  v  to  etj  it  mi?ht  seem 
that  we  should  somehow  indicate  that  we  are  talking  about  v,  v9 ,  vy,  com¬ 
puted  from  within  et  j.  However,  the  basic  constraint  on  our  space  S„  is  pre¬ 
cisely  that  these  values  of  the  four  nodal  points  are  continuous.  Therefore. 
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these  four  values  can  be  associated  with  the  geometric  point 

It  is  convenient  to  describe  Sn  in  terms  of  a  local  basis  for  the  restriction  to 
Bij.  On  the  interval  Osz£l  define  the  functions 


V0(*)  :=  (1  -  z)a(l  +  2x).  T0(z)  :=  x(l  -  x)2, 
Kt(z)  .=  zz(3  -  2z),  7i(z):=(z-  l)xz. 


(6.14) 


These  cubic  polynomials  satisfy 

k0(o)  =  l.  vb(i)  =  r0{o)  =  r0(i)  =  o, 

r0(o)  =  l.  7’c(i)=  r0(o)  =  r0(i)  =  o. 

r,<0  =  l.  Fi(o)  =  V- j(o)  =  r,(i)  =  o. 

T'i(i)  =  l.  r,( o)  =  r,( o)  =  r,(i)  =  o. 

Then  the  restriction  of  v  to  j  may  be  written  as 


(6.15) 


1^*0. 1 


t,P*0.1 


+  2  bViVy'ii+l.J+pVi 

If*  0.1 


Z  -Xt 

T7 

1  v  -  Vi 

Ax 

ND 

{  by 

z  -  zt 

T/ 

y  -  Vi 

Az 

Ay 

*  -*«  ’ 

T 

y  -  Vi 

Az 

by 

(6.16) 


+ 


2  bcby(v*y)i*i.j+fiTl 

lf*0.1 


X  -  x< 

T 

y  -  Vi 

Az 

*  P 

by 
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Once  we  have  this  representation  for  the  restriction  of  v  to  et  J-  we  can  com¬ 
pute  the  "local  mass  matrix  and  the  "local  problem  matrix  How¬ 

ever,  while  we  will  compute  some  of  these  coefficients  later,  for  our  present  pur¬ 
poses  it  suffices  to  observe  the  following  form  of  these  matrices,  Let 

Vij  :=  ( Vij .  A x(v9)ij,  ty{vv)i,j,  AxAy(v*y )<.,)‘  (6.17) 

be  the  4-vector  of  interpolation  conditions  at  the  point  and  let 

:=  ( Vij.  K+1J.  (6. 18) 

be  the  16-vector  of  all  the  interpolation  conditions  for  v{x,y)  restricted  to  e^j. 
Then,  for  u  and  v  e  Sn,  with  v  represented  by  j  and  u  by  U.:j  on  ei  ;-,  we  have 

If...  uV  dxdy  =  Ax  Ay  vYj  QoUi.j .  (6- 19) 

where  Q0  is  a  constant  16x18  matrix  independent- of  Az,  Ay.  or  Similarly, 


f  fm  b(u,v)dL:  dy  -  (AxAy)P'<j[(Ax)"za8  +  (Az)  !a,  +  (6.20) 

■•J 

where  a0.  a,.  and  az  are  16x16  matrices  that  depend  on  ( i,j )  and 

a0  is  independent  of  (Az  ,Ay )  (6.21) 

while 

aj  and  o8  depend  only  on  r  :=  (6.22) 


The  matrix  oa  corresponds  to  the  portion  of  b  (u  ,v)  given  by 
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auz€z  +  b{'LLz-Oy  +  UyVx)  +  cUyVy  (6.23a) 

and  is  a  positive  definite  real  symmetric  matrix.  The  matrix  corresponds  to 
the  portion  of  b(u,v)  given  by 


(cfjit,  +  dzUy)v ,  (6.23b) 

while  the  matrix  a0  corresponds  to  the  portion  of  b(u,v)  given  by 

dQuv  (6.23c) 

and  is  a  real  symmetric  positive  semi-definite  matrix. 

From  these  local  matrices  one  can  easily  construct  the  mass  matrix  Q  and 
the  problem  matrix  A\  see  for  instance  [  19]. 

Let  Vj  denote  the  vector  of  all  unknowns  associated  with  the  l’th  horizontal 
line  y  -  yt:  using  (6.17), 


Vi  =  (V/i.  Vii.  ’  •  '  .  Vfo)*.  (6.24) 

Now  let  V  denote  the  vector  of  all  unknowns  ordered  by  lines,  i.e.. 

V-  (V{.  Vi,  •  •  •  .  VjSyy.  (6.25) 


Then  for  any  u  and  v  e  Sn  we  have 

rfauVdxdy  -  LxLy  V'Q  U,  (6.26) 

where  Q  is  a  {APzPv)^{APzPy)  constant  matrix  that  is  independent  of  Ax  and  Ly . 
Further,  the  finite  element  approximation  (2.10c)  corresponding  to  (2.7)  with 
this  choice  of  5„  and  these  interpolation  conditions  becomes 
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A  A 

AU  =  F, 


(8.27) 


where 


A  =  AxAy[{Ax)~zAz  +  (Ax)-1Ax  +  A0]  (6.2B) 

and  4o.  Ax,  and  A2  have  the  same  qualitative  features  as  a0.  at,  and  a2.  For 
example,  A2  corresponds  to  the  portion  of  b(u,v)  given  by  (6.23a)  and  is  a  real 
symmetric  positive  definite  matrix  that  depends  on  Ax  and  Ay  only  through  the 
ratio  r  =  Ay/  Ax . 

The  matrices  Q  and  A  may  be  regarded  as  (PzPy)x(PxPy)  block  matrices, 
where  each  block  is  itself  a  4x4  matrix.  This  is  the  "geometric  point”  represen¬ 
tation  of  Q  and  A.  In  this  representation  both  Q  and  A  correspond  to  nine-point 
schemes.  That  is.  the  (ij)  block  equations  are 

(A&)ij  =  AijijUij  +  £  ~  Fij.  (6.29) 

+  2  (6.30) 

We  also  consider  the  A: -line  representation  of  this  problem.  Let  k  a:  1  be  a 
fixed  integer.  We  assume  that*  divides  Pv,  i.e., 

Pv  =  kPk  (6.31) 


where  Pk  is  of  course  an  integer.  Let  u  e  Sn  and  let  D  be  the  associated  vector 
of  interpolation  conditions.  Let  U,{k)  be  the  Rector  associated  with  the  s’th  set 
of  *  horizontal  lines:  , 


-41  - 


£/.(*)  =  Ctf(. -!)♦*. 


(6.32) 


In  this  representation,  the  problem  matrix  >4  and  the  mass  matrix  9  become 
block  tridiagonal  matrices.  That  is.  the  equation  (2  16)  takes  the  form 


)  ^4 -i(fc )  +  At*  (fc )  Ut  [k )  +  4».* ♦  i(^ )  Ut +  i(fc ) 
=  ^»(*)  (lSs<Pk). 


(6.33) 


The  matrices  are  (ikPg)x(4rkPs)  matrices. 

Let  us  consider  the  block  Jacobi  iterative  scheme  based  on  this  fc-line 
representation  of  A.  Given  a  first  guess  0*0*  we  have  the  iterative  scheme 

*,-i(W£Tl)(*)  +  4,,(*)tf.M(*)  +  *.,+i(*)C#7l)  =  /;(*).  (634) 

Thus,  in  the  notation  of  section  2.  we  have  (2. 15)  with 

M  :=  diag[4,^(*)].  N  :=  i(&).  0.  -'^*.*+i(^)]>  (6.35) 

where  the  notation  in  (6.35)  means  that  N  is  a  block  tridiagonal  matrix  with  the 
three  principal  diagonals  as  written. 
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7.  The  model  problem:  estimates. 

In  this  section  and  the  next  we  turn  to  an  analysis  of  block  iterative 
methods  for  this  model  problem  -  with  a  complete  analysis  of  fc-line  block 
methods.  Our  first  goal  is  to  simplify  the  study  of  the  bilinear  form 

Ax  A yV'N  U. 

In  particular,  the  estimates  that  follow  enable  us  to  ignore  many  of  the  elements 
of  N  when  determining  a  function  q  (x  ,y)  that  meets  the  conditions  of  A.3. 

Leuua  7.1.  Let  0  be  the  unit  square  and  let  n  be  the  16-dimensional  space  of 
polynomials  in  (x  ,y)  e  0  that  are  cubic  in  each  variable  separately.  Hence,  if 
g  e  jt.  then 


=  £  9r *xT y* .  (7.1) 

rji*  0 

There  is  a  constant  C0  >  0  such  that 

4-  £  I  9  (ff.M)t8  *  Collpilo.  (7-2a) 

4  <*.*) 

Ilff  C0|| Vp Ho  =  C0lg  I?.  (7.2b) 


£  I  9  (ff.M)  -  9  (*>')  I  *  £  Coll  Vg  ||0a.  (7.2c) 


i  £  \(Dag)M\z*  Coll vp Ilf, 

|a|»l  (o.m) 


(7. 2d) 


where  (a.fx)  and  (a‘,/z')  are  any  of  the  four  corner  points  (0,0),  (1.0),  (1.1),  (0,1). 

Proof.  Because  n  is  a  finite-dimensional  space,  any  seminorm  |  •  |  is  dom¬ 
inated  by  any  norm  ||-||:  there  is  a  constant  C  so  that  |g  |  £  C||p||  for  every 
g  e  n.  This  establishes  (7.2a).  Fix  a  corner  point  (<x,p)-  Consider  the  norm 
defined  on  n  by 


:=  \g(°,p)\z  +  Iloilo-  (7.3) 

Because  n  is  a  finite-dimensional  space,  there  is  a  constant  C  >  0  such  that 

llfllf  *  Clllflll?**)  for  all  p*  e  rr.  (7.4) 


Set 


g (x.y)  :*  g(x.y)  -g(o.p)  (7.5) 

Then  (7.2b)  follows  from  (7.4)  with  C  in  place  of  Cj. 

Let  (o'./j.')  be  another  corner  point,  and  set 

S(<r>)(p)  :=  I g(a'.p')}. 

Then  is  a  seminorm  and,  as  before, 

Sfcrfig)  *  Cjlllp  |||fff,M)  for  all  j  err.  (7.6) 

Let  g  be  given  by  (7.5).  Then  (7.6)  yields 

\g(a'.fi')  -g(a.fi)  |8s  C,!|Vp|||. 


Summing  this  inequality  over  all  pairs  (a,p),  (a'.p'),  we  obtain  (7.2c)  with  C0 
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replaced  by  I6C1. 

Let  5  be  the  seminorm  defined  by 


s*(9)  =  t  t  I (£“<;)(*>') I *■ 

|a|«l  a>'*0 

The  argument  given  above  now  yields  (7. 2d).  Let  C0  be  the  largest  of  the  con¬ 
stants  and  the  lemma  is  proven. 

For  convenience,  we  collect  some  definitions  here.  Throughout  this  section 
and  the  next,  we  set 


h.  ;=  yfKz~Ky. 

For  each  e*  j  and  for  every  u  and  v  in  Sn ,  let 

Finally,  for  every  u  and  v  in  Sn  we  set 

ri{u,v,h)  :=  h(||u||0||Vi;||o  +  ||v||ol|Vu||0)  +  /i2||Vu||o||Vi>||0. 

Note  that 

%r}(u,v £  r){u,v  ,h). 

•u 

Lehua  7.2,  Fix  (i.j)  and  let  v  e  5„.  Let  P  and  P'  denote  one  of  the  corner 
points  (xt.yy).  (xm,yy),  (x<4.  ity+i).  (*i.y>M)  Of  ei}.  Then  there  is  a  constant  C, 
depending  onr  and  1/r  such  that 


*b5i*(p)ib*c1ii«ii*1^. 


(77a) 
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II W  -viPM-.'tj  <  ^CjIIVwII#^  =  A*C,|  v  1?,^.  (7.7b) 

h*  £  £Ax2>/8a*j(fl“u)(P)|zi;  C^IIWIII  (7.8) 

|a|»l  P 

h*  £  l«(i»)  -  u(P')l2*  C^HVvIll  (7.9) 


Proof.  Set 


tj  :  = 


y  -  Vi 

by 


Let  v  be  any  function  in  5„  and  set 

9(S.V)  v(Xi+Sbx.yj+r)by)  (0  £  £,  n  s  1). 

The  function  y(f.Tj)  is  an  element  of  n.  Moreover,  a  direct  computation  shows 
that 


ff.tJ  \  v*\2dxdy  =  -^-//n  |pf|8dfdT7  =  r//fl  |  g( \ad(dV, 


l^^dy  =  I  ^|arf^c£T7  =  -i-//0  |^n|8dfdr7. 

Let 


r  :=  max  (r,  1/r) 


Then 
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II  Vv  |||;flJ  *  f  ||  V*  ||*  *  *■«  V./  \\l.tJ .  (7.10) 

Another  computation  shows  that 

f  fHj  \vix>y)\Zdxdy  =  h2f fa\g{tr})\2dSdr)‘  (7  H) 

Therefore  the  inequality  (7.2b)  of  Lemma  7.1  yields 

II*  c0fhz||Vv||!;.ir 

which  proves  (7.7b).  Inequality  (7.7a)  follows  from  a  similar  change  of  variables 
and  (7.2a). 

If  we  define 


8l«l 


8xai3ya* 


Df 


(7.12a) 


then  we  see  that 


6xUl&yatD£v(x,y)  =  D£g{$,ri).  (7.12b) 

Thus  (7. 2d)  of  Lemma  7.1  yields  (7.8)  with  Cx  =  CqT .  Finally,  (7.2c)  of  Lemma  7.1 
yields  (7.9). 

Corollary  7.3.  There  is  a  constant  C8  independent  of  (i.>)  such  that 

-^-(*<J  +  Vui.i  +  =  ll*llo;.u  +  (7.13) 


where 


|fJ(v,Az)|  <  Cgtj(v ,v,h,i,j). 


(714) 
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Proof.  For  each  index  ( i+l  ,j  +p)  we  apply  (7.7b)  to  obtain 
II v  -•ut+u+pllo*u  *  hvTIII^IIo;^. 
Hence  the  triangle  inequality  yields 

KIMIoi.^  l«t+u+pl)l  ^AVPIllVwllo;^ 


and 


h  I  vi«.j+p  I  *  IMIo*^  +  hVr7ll?t'|[0;,<j.  (7.15a) 


Therefore 


^Z|v<+<J+p|2=  l|v|ll;t<iy  +  £(«.*). 


where 


|£(t/,h)|  i  Crj(v ,v 

We  add  the  four  equations  for  all  (i+lj+p)  and  divide  by  4  to  obtain  (7.13). 

Theorem  7.4.  Let  u  and  v  e  Sn.  Let  v  e  Cl{U).  Then  there  is  a  constant 
K  >  0  such  that 


P  P 

h*£  £\Vi.j\**K\\v\\l  (7.16a) 

i»i )• \ 


f fa<pva*z<*y  =  ke£<PijUtjVij  *  6{u,v,v),  (7.16b) 


where 
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|6(u,t/,p)|  £  K{  1  +  j|V^|j.)T7(u+w.u-v,/i). 


(7.16c) 


Furthermore, 


t  Kh.*\\Vu\\l 


(7.17) 


i.i  !«l*l 


h2Z  S  \tea'*p'by*t¥l,t{D*u)ij{Dl>v)i'j\  *KV{u,v,h). 
ij  |a|  +  |0|*i 


Proof.  To  get  (7.16a),  sum  (7.7a)  over  all  elements  etj.  The  estimates 
(7.16b)  and  (7.16c)  follow  from  (7.13)  and  (7.14)  of  Corollary  7.3  applied  to 
(u  ±  v).  together  with  simple  estimates  on 


/  /.,  ?u€  tody  ~  <Pij  //,  uv  dx  dy. 


The  first  estimate  of  (7.17)  comes  from  (7.8)  of  Lemma  7.2. 

In  order  to  complete  the  proof  of  (7.17)  we  need  only  consider  the  case 
a  =  0.  |0 1  &  1.  We  have 


(^(uum8^2  E  i(^)ua*(Vt)i/z 

IJI»1 


A  direct  computation  from  (7.7a)  and  (7.17a)  gives 


/*A7i||u||0|lVi/|lo. 


whence  (7.17b)  follows. 
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We  are  now  ready  to  apply  these  estimates  to  the  study  of 

AxAy.iV  =  h2N 

and  the  determination  of  the  function  g  ( x,y ). 

Theorem  7.5.  For  every  vector  V  =  (ytj),  let  V°  be  the  vector  with 


v, 


0 

0 

0 


(7.18) 


Suppose  N°  is  a  matrix  such  that  for  every  u  and  v  e  Sn  we  have 


hzVotN°U°  =  h2V°'NU°  +  tf(u.v.Ax), 


(7.19a) 


where 


|tf(ti.v,Ax)|  i  Ctj(u.u.A).  (7.19b) 

Then  if  N°  satisfies  A.  3  so  does  N. 

Proof.  From  the  estimate  (7.17b)  we  see  that 

0(if  (u  ,v  ,h)). 

Hence  when  verifying  A.3  it  suffices  to  consider  P°,  U°,  and  matrices  N°  that 
satisfy  (7.19). 

This  theorem  shows  that,  to  apply  Theorem  5.1,  we  need  consider  only  the 
vectors  and  0°,  and  matrices  N°  satisfying  (7.19).  In  particular,  we  may 
ignore  components  that  come  from  derivative  terms. 


K. 


Suppose  that  the  splitting  (2.15)  is  a  "natural"  block  splitting  of  the  kind 
described  in  Section  3.  That  is,  a  nonzero  element  of  -N  is  exactly  equal  to  the 
same  (same  indices  (i.j))  nonzero  element  of  A.  Then  it  follows  from  Theorem 
7.5  that  for  the  purpose  of  determining  q  and  verifying  A.3.  if  suffices  to  con¬ 
sider  the  same  splitting  of  the  matrix  A0,  which  is  a  block  matrix  consisting  of 
4x4  blocks  where 

®  i  j  ,<r  .n  0  0  0 

n  0  0  0  0  , 

-  A x&y  q  0  0  0  (7.20) 

0  0  0  0 

and 


“ij.id 


°vi  j  312 

Ax8  Ay8  175 


(7.2la) 
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(7.22b) 


(7.22c) 


(7.22d) 


(7.22e) 


Remarks.  As  (7.21)  and  (7.22)  show,  on  each  element  etj  we  have  approxi¬ 
mated  the  variable  coefficients  a,  6,  and  c  by  constant  coefficients  eq^,  6tJ-,  ci  jt 
respectively.  One  could  "center”  the  coefficients  ,  6t  j.  and  ctj-  in  these  equa¬ 
tions.  However,  for  the  purpose  of  determining  q  this  increased  accuracy  is 
irrelevant.  Only  the  coefficients  a (x,y),  b(z,y),  and  c(z,y)  enter  into  the  for¬ 
mulae.  This  follows  from  the  discussion  in  Section  6  describing  az,  at.  and  ao.  or 
equivalently  As,  A and  .40  --  see  (S.20)-(6.23)  and  (6.2B). 
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8.  The  (unction  q(x  ,y):  two  iterative  schemes. 

In  this  section  we  use  the  results  of  Section  ?.  together  with  arguments 
already  developed  for  finite  difference  equations  (see  [15]).  to  determine  the 
function  q  that  satisfies  the  conditions  of  A.3,  We  consider  both  the  A: -line 
Jacobi  iterative  scheme  described  in  Section  6  and  the  point  Gauss-Seidel 
method. 

The  finite  element  spaces  Sn  described  by  (8.11)-(6. 13)  satisfy  the  inverse 
inequalities  (5.3).  Moreover,  because  the  A; -line  Jacobi  scheme  satisfies  block 
property  A,  condition  (5.4)  holds.  Hence  to  apply  Theorem  5.1  we  need  only  to 
confirm  (5.2)  and  to  show  that  A.3  holds  with  an  estimate  of  the  form  (5.1).  Now 
(5.2)  follows  from  observing  that  the  nonzero  coefficients  in  ( N—N *)  come  from 
coefficients  in  the  problem  matrix  A  that  originate  in  the  term 

toy  A I 

of  (6.28);  but  this  term  is  of  size  0{h).  To  finish  the  study  of  the  A: -line  Jacobi 
method,  we  determine  q  in  the  following  theorem.  Of  course,  wa  will  use  the 
matrix  N°  that  comes  from  A0  delined  by  (?.20)-(7.22).  N°  acts  only  on  the  vec¬ 
tors  V°  and  C/°.  We  define  the  norm 

\\N°\\k  :=  sup  :  £  I  1 2  =  U- 

*J  ij 

Theorem  8.1.  Consider  the  A: -line  block  Jacobi  method  described  by  equa¬ 
tions  (6.34).  There  is  a  function  7  that  satisfies  A.3  and 

=  -y--—c(z,y).  (B.la) 


Therefore 
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p  =  1  -  Ao^8  +  o  (A2), 


where  Ao  is  the  minimal  eigenvalue  of  (4.1).  Hence  from  (1.6)  and  (1.7) 


P/(* 0  =  1  -  -f§-iVi8  +  o(h8),  Pcs{k)  =  1  -  -f-rvi2  +  o(Az), 


P*  =l-2(-f-r0)"zA  +  o(A). 


(8.1b) 


(B.lc) 


Proof.  Following  the  development  in  Section  6  we  see  that  it  suffices  to  con¬ 
sider  the  matrix 


=  -  [4°,-i  (fc).O.  A.Vi(*)] 


(B.2) 


where  A,Jti{k)  are  (4fcP’,)x(4*:/3I)  matrices  of  the  form 


0  4ft.  -l)+l^e(»-l)  (1) 

0  0  ' 


(8.3a) 


4.°^,(*):= 


t.ka+l 


(1)  0 


(8.3b) 


The  matrices  4to+uwU)  and  4 are  the  (4-P*)*(4.Px)  matrices  that  arise 
in  the  case  k  =  1.  These  matrices  are  themselves  block  tridiagonal  matrices  of 
the  form 


Ajjtl  (l)  =  [4?>;i-]./±l  •  ] 


(8.3c) 


ii 


where  the  matrices  Aft##  are  the  4x4  matrices  given  by  (7.20)-(7.22c). 
A  direct  computation  now  yields 
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p  p 

£  [^*»4&+i^(i)C4.]-  (8.4) 

**i  a*i 

We  rewrite  (8.4)  as 

9°‘N°Ua  =  -  §  +  4S*-i)£4. 

2  ( ^*»*i  —  t/**)  “  S  Kt»(^te+ijc»  —  A&jc -i)C/te  (8.5) 

**1  *=1 

+  ♦ijk»  £4»  ■ 

•«i 

It  follows  that 

KO^Oj>o  =  _  £  ^(4&.*,+i  +  A&mL l)Uk.  +  (8.6a) 

■  *i 

where 

I E(?°.u°) |  *  ||jv°|U(E |  vtJ  \*y'*{Z  I ^J+I  - Uij \ZV'* 

4  HiV0|U(2l«ijl8)l/8(Sl«tj+i  -  v*jl2)I/a  (8.6b) 

+  Mil™  II-  +  r||7a||.  +  -~l|Vc  ||J(£  '  VU  !2)1/8(E  I  «t  j  I z)uz- 
Using  the  defining  equations  (7.20)-(7.22c)  we  see  that 
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P  P 

v°'n°u0  =  2  t  +  «<♦.,*.) 

a-l i«j  l'°  r 

(8.7) 

*  f!  SlTTFib*-  -  +  £(v“.5«). 

,.i  i"  r  175  175 

Because 

+  '“iMJta  =  2l^j»  +  (“t-ljto  “  “i.to)  +  fai  +  ijfc.  “ 

we  see  that 

P  P 

i(~-^rciM)viJC,uiJea  +  E(9°M°)  +  £,1(^°.E/°).  (8.8) 

aal  i  =  l  °  r 

where 

-jH-llr.  +  -i-o IUtS  I «, J  I*) •'•(S  I  «... J  -UU|,),'>. 

The  estimates  of  Theorem  7.4  now  show  that 

h*(E(V°,U°)  +  2r,(K°.  U0))  =  0{rj  {u,v  ,h)), 

whence  from  (8.8) 

P  P 

h*V°'N°&0  =  ha2  ^(-^-^rCijwMjkaUijfc,  +  0{rj(u,v,h)). 

B-l  <-l  0  T 

To  complete  the  proof  of  Theorem  8.1  we  employ  an  argument  of  [15.  sec¬ 
tion  5].  Let  j  =  1.  2,  Then 


vijm*i  =  viJ*  +  Gijm+jft9),  Utjm+i  ~  ««,*»  +  GijM+i(&0)’ 


(8.9) 


-56- 

where  for  any  vector  W°  we  define 

G»,***/(^0)  :  =  £  (wiM  +M  ”  Ju+p- 1) 

M-l 

Observe  that 

I  GW*0}  I  *  S«-<*°)  :«  ^2(i (8.10) 

M-l 

Therefore 

~  ^i.ka^.ka  +  jk*  *-j  (  P°.  U°).  (8.11) 

where 

[iWi(P°.&0)l*  |t/i.ta|2lo(&0)+  !*u,|8<,(p°)  +  ^(&°)^(V°). 

Thus 


=  ciMCiM^.k.  +  Ajte*i(&°.^°).  (8.12) 

where 

IAW^.^I*II«IU*J**<?0.&°>|  +  Ay ||Vc |. 

Sum  equation  (8.12)  for;  *  1.  2,  •  •  •  .  k  and  divide  by*.  We  obtain 

■J jr&iM+jViM+iUifj  =ciMiJ iMUiM  +■  H(V°,  U°,c )  (8.13a) 

where 
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|/f(?°.D°.e)|  s||c||.(|viJta|S^(&°)  +  KJfc.|5^(K0)) 

(8.13b) 

+  l|cil-2<..(£/°)S^(P0)  +  Ay  ||  7c  ||.  |  viJa  |k,b|. 

Returning  to  (8.8),  we  have 

P  P 

Ax  A yV°‘N°U0  =  AxAy£  E  ~T~  +  e(?°.&°).  (8.14) 

Jal i«l  0  KT 

where  the  definitions  of  ^(V0.^0),  E^V *,&*).  and  H{V°,U°.c)  yield 

\e{V°.U°)\*K(r)r)(u,v.h),  (8.15) 

and  the  constant  K(r )  depends  on  (r  +  1/r),  all  the  coefficients,  and  all  their 
gradient  magnitudes  ||7o||.,  ||V6||„,  and  ||7c||..  The  theorem  now  follows  from 
the  estimates  of  Section  7. 

We  now  turn  to  the  case  of  the  point  Gauss-Seidel  iterative  method.  First, 
let  us  clarify  our  terminology.  In  some  sense  there  are  two  such  methods.  In 
one  case  we  think  of  the  geometric  point  (x1,y^)  and  associate  with  each  such 
point  a  4-vector  V  In  the  course  of  this  point  Gauss-Seidel  scheme  we  must 
invert  a  4X4  matrix  at  each  point.  Alternatively,  one  may  also  consider  the 
usual  Gauss-Seidel  method,  in  which  one  inverts  the  main  diagonal;  hence  at 
each  step  we  invert  a  scalar. 

However,  the  estimates  of  Section  7  and  the  argument  of  Theorem  7.5  show 
that  for  finding  q  these  methods  are  the  same,  in  the  sense  that  they  both  yield 
the  same  function  q . 

Unfortunately,  for  the  point  Gauss-Seidel  method  we  cannot  verify  (5.4). 
Hence,  although  we  can  determine  g  in  general,  presently  we  can  assert  only 


that  the  point  Gauss-Seidel  method  converges  for  seif-adjoint  problems.  Conver¬ 
gence  in  this  instance  follows  from  application  of  classical  principles;  see  for 
example  [20],  Even  in  this  case  we  cannot  prove  that  (5.4)  holds,  so  we  cannot 
establish  the  upper  bound  on  p.  But  in  general  we  do  have  the  lower  bound  of 
Theorem  4.2.  The  next  theorem  summarizes  these  results. 

TtoEOiKH  B.2.  Let  the  unknowns  be  ordered  lexicographically  and  consider 
the  corresponding  Gauss-Seidel  iterative  scheme 

~  ~  (■At.j.i-l.J  +  ) 

“  )  (B.  16) 

(At.i:<-t-ij  +  M44-14+1V&&X  +  IA+Tj'Vi  )  +  Fij. 

There  is  a  function  9  that  satisfies  condition  A.  3  and 

q(x.y)  =  ~|-[ra(x,y)  +  “c  (*  ,y)]:  (817) 

moreover, 

pi  1  -  Aoh®  +  0  (hz),  (B.  18) 

where  Ao  is  the  minimal  eigenvalue  of  (4.1).  Of  course,  when  L  is  self-adjoint  the 
point  Gauss-Seidel  method  is  convergent. 

Proof.  Theorem  4.3  implies  (8.18).  Using  A0  rather  than  A  we  see  that 

♦  ±e,jJ  - 
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+  £< 


27 

175 


iraij  +  + 


fri.jUi 


54 

175 


raij  + 


156  1 


+  2( 

U 


156 


175 


■raij  - 


54  1 

175  r 


ct.i  )viju i+lj- 


The  proof  now  follows  from  am  argument  similar  to  --  but  much  simpler  than  - 
the  argument  in  Theorem  8.1. 


I] 


9.  Comments. 

As  we  have  mentioned  in  the  introduction,  the  basic  theorems  of  section  4 
are  closely  related  to  earlier  finite  difference  results.  Yfhile  Theorems  4  4  and 
5.1  are  far-reaching  extensions  of  our  earlier  work  that  are  important  for  higher 
order  and  nonself-adjoint  problems,  even  in  the  self-adjoint  case  the  finite  ele¬ 
ment  equations  present  difficulties.  One  of  the  difficulties  arises  from  having  to 
deed  with  the  many  interpolation  parameters,  e  g.,  the  36  terms 

.j+pl'  j+pi*  I  ("“v  )<«„*+/>!•  \(usy)i+l.f+p\' 

with  l  and  p  running  over  the  set  J-l.  0,  1],  of  the  finite  element  equations  at  a 
point  ( Xi.yj ).  It  would  be  difficult  to  find  g  and  verify  A. 3  if  one  had  to  deal  with 
all  these  terms.  However,  Theorem  7.4  adlows  one  to  restrict  attention  to  the 
nine  function  vadues 

This  observation  leads  one  to  ask,  are  the  estimates  of  Theorem  7.4  specific 
only  to  these  cases,  or  can  the  estimates  be  obtained  for  a  general  class  of  finite 
element  spaces?  Looking  at  section  7,  we  see  that  there  are  two  points  essential 
to  the  development  of  Theorem  7.4. 

(1)  The  interpolation  parameters  consist  of  function  values  and  derivatives  at 
certain  vertices  of  the  element  ei  i. 

(2)  There  are  a  fixed  and  finite  number  of  finite  dimensional  spaces 
Wj,  nz.-  -.ng  (in  our  case,  R  =  l),  and  for  every  Sn  it  is  true  that  to  each 
element  aij  there  corresponds  a  fixed  tr4  and  a  smooth  mapping  for  which 
the  rastrict-ioTis  of  the  functions  of  5„  to  etj  are  the  images  of  under  the 
mapping.  See  Lemma  7.2.  Furthermore,  in  rrt  one  obtains  estimates  like 
those  of  Lemma  7.1. 

Therefore  It  is  quite  clear  that  this  approach  to  the  simplification  of  (P’jV  V) 
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will  apply  to  many  finite  element  spaces  Sn.  In  particular,  it  applies  to  all  the 
nodal  finite  element  spaces  (see  [18],  [19]),  provided  that  there  is  some  regular¬ 
ity  of  the  elements  a  whose  union  is  0  -  say.  provided  that  the  diameters  of 
neighboring  elements  vary  slowly.  Now  we  ask,  given  that  such  estimates  hold 
and  the  analysis  of  {V'Nlf)  is  reduced  to  a  study  of  (F°*A/°C/0),  which 
corresponds  to  a  related  generalized  finite  difference  equation,  should  one 
expect  to  find  a  q  for  general  domains  and  general  elliptic  equations?  The 
answer  appears  to  be  yes!  For  the  finite  difference  case,  this  point  is  discussed 
in  [15.  section  9].  Of  course,  if  one  really  wants  to  determine  q  and  hence  the 
asymptotic  form  of  p,  one  must  work  out  the  details  in  any  particular  case. 

Even  when  q  is  known,  the  eigenvalue  Ao  is  not  readily  available.  Hence  one 
might  question  the  practical  value  of  this  theory.  However,  there  are  at  least 
four  important  ways  in  which  the  theory  is  useful. 

(1)  There  are  cases  -  model  problems  -  in  which  one  can  compute  the  eigen¬ 
values.  For  these  model  problems  it  is  then  possible  to  compare  different 
methods. 

(2)  In  second  order  elliptic  problems  with  nice  boundary  conditions,  and  in  gen¬ 
eral  self-adjoint  elliptic  problems,  the  smallest  eigenvalue  is  monotone 
decreasing  in  q  .  that  is,  if  q  j(x)  <  qg(x)  for  all  x  e  0,  then  Ao(gi)  Js  Ao(ga). 
In  these  instances  qualitative  comparisons  of  different  methods  are  possi¬ 
ble. 

(3)  Consider  the  A; -line  methods.  Here  the  basic  blocks  are  monotone  in  k 
This  fact  is  reflected  in  (8.1),  where  q  is  inversely  proportioned  to  fc,  so  that 
A®  *  ar0  is  directly  proportional  to  k.  Thus  (8.1a)  and  (1.5)  hold.  Hence 
we  can  compare  A: -line  methods  for  different  values  of  k  even  when  we  do 
not  know  the  exact  value  of  1®.  It  is  easy  to  Imagine  a  situation  where  one 
h»«  such  cases  of  monotone  blocks.  We  should  then  be  able  to  compare 
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mir  aods  without  knowing  the  basic  IV 

(4)  Consider  the  relationship  between  the  fc-line  Gauss-Seidel  method  and  the 
point  Gauss-Seidel  method(s),  which  is  revealed  by  comparing  Theorems  8.1 
and  8.2.  By  computing  the  work  per  sweep,  one  easily  sees  that  —  in  the 
best  of  circumstances,  where  p  is  as  small  as  possible  and  equality  holds  in 
(8.18)  --  the  A: -line  Gauss-Seidel  methods  are  to  be  preferred  to  the  point 
Gauss-Seidel  methods.  For  instance,  in  the  simplest  case  where  r  =  l  and 
a  -  c  -  1,  we  see  that 

Pcs(*)  *  1  -  pcs(poinf)  *  1  -  rr2/*.2 . 

We  now  turn  to  another  aspect  of  these  results.  For  second  order  problems 
(to  =  1),  the  basic  Jacobi  and  Gauss-Seidel  methods  —  but  not  the  SOR  method  - 
have  spectral  radii  p  »  1  -  Khz.  The  exponent  2  arises  from  the  fact  that  the 
elliptic  equation  is  of  second  order;  it  has  nothing  to  do  with  the  dimension  of  0 
or  the  order  of  accuracy  of  the  discretization  method,  which  in  the  case  of  Her- 
mite  cubic  splines  is  4.  Thus  for  reasonably  desired  error  tolerances,  the  finite 
element  h.  is  large  compared  to  the  usual  finite  difference  h ,  and  the  finite  ele¬ 
ment  p  is  correspondingly  smaller. 

Block  splittings  based  on  geometrically  natural  blocks  have  a  property  that 
is  important  for  exploiting  new  computer  architectures:  the  corresponding 
problems  (2.16)  are  easy  to  set  up  on  vector  and  multiprocessor  machines, 
because  M  decomposes  into  independent  submatrices.  The  coupling  between 
subregions  of  0  is  isolated  in  N .  Hence  overhead  associated  with  data  transmis¬ 
sion  between  processors  is  small.  Moreover,  decomposition  of  (1.1)  into  (2.16)  is 
easily  managed  by  hand.  This  is  a  telling  factor  where  operating  systems,  com¬ 
pilers.  and  other  supporting  software  are  unlikely  to  make  available  to  users  all 


the  resources  of  multiprocessor  machines  in  a  simple  way.  Leaving  aside  this 
practical  point,  we  note  simply  that  the  independent  subproblems  of  (2.16)  can 
be  attacked  simultaneously  by  independent  processors.  Hence  block  decompo¬ 
sitions  permit  parallel  computation  even  as  they  provide  improved  convergence 
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Appsndix:  the  eigenvalue  problem. 

The  major  purpose  of  this  section  is  to  prove  Lemma  4.1.  Let  us  clarify  the 
notation  and  restate  the  basic  hypothesis. 

With  every  function 


u(x)  =  '£Uivi(x)  e  Sn  (a.la) 

we  associate  the  vector  of  coefficients  of  u 


U=  (Uu  U2,  •  •  •  .  Un)1. 


(a. lb) 


There  are  three  basic  matrices  A,  Q,  and  N,  which  satisfy 

P'AU  =  B(u,v)  for  all u  and  v  e  Sn .  (a. 2a) 

9*QLf-  fuvdx  for  all  u  and  v  e  Sn ,  (a. 2b) 

7*(/iZw7V)  U  ~  J quv  dx  +  en(u,v)  for  all  u  and  v  e  5n .  (a. 3b) 

Here  q  e  C^O).  q{x)  St  q0  >  0  on  0, 

|en(u.i/)j  s  T?(n)[(l+!|u||l)(l+j|t;||1)  +  ||uj|?  +  IMI?].  (a.3c) 


and 


rj(n)  -*  0  as  n  -* 


(a.  3d) 


Note  that  A. 3  implies  (a.3c). 
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We  are  concerned  with  the  eigenvalue  problem 

AU=  (ihZm  N  U,  U*  0  (a.  4a) 

and  its  relationship  to  the  eigenvalue  problem 

B  (it  tv )  =  Afquv  dx  tor  &U.  v  S.  llm .  (a. 4b) 

This  latter  problem  is  completely  equivalent  to  the  problem 

Lu  -  Aqu  inf),  6;u  =0  on  30  (0  ^  m-l).  (a.5) 

Lemma  A.l  (Lemma  4.1a),  Let  be  a  bounded  sequence  of  eigenvalues  of 
(a.4a),  so  that  there  is  a  constant  C  >  0  for  which 

\Hn\aC.  (a.  6) 

Then  the  limit 

AU.  :=  lim„ (a.7) 

of  every  convergent  subsequence  {/vj  is  an  eigenvalue  ol  (a.4). 

Proof.  Let  U(n)  be  the  eigenvector  corresponding  to  n normalized  so 

that 

||u(n)|!0  =  1.  (a.  8  a) 

Thus 


D*(n)A»  &(n)  =  A*n  tr(n)(^Nn)t\n). 


(a. 8b) 
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Using  (a.3b)  and  (a.3c),  we  get 

U0(n)AnU{n)  =  ^fq \u\zdx  +  en{u  ,u)  (a.9) 


and 

|en(u,iz)|  -s  rj(n)(2  +  4!|u(n)||,8). 

Therefore  from  (2.5)  we  have 

/r0||u(n)||8  ^  R e(tr(n)AnU(n))  £  C)|gi|.  +  i?(n)(2  +  4||u||f). 

Hence  for  n  large  enough 

l|t*(n)||®  £  (a-lOa) 

Now  choose  a  convergent  subsequence  and  let  Its  limit  be  /x».  By  (a.lOa) 
there  is  a  subsequence  |n”J  of  and  a  function  p  e  Hm  so  that 

14(71")  -»  ^  weakly  in  Hm  (Q).  (a.10) 

If  v  e  f}m  and  v [n)  is  its  Hm(( 1)  projection  onto  5n,  then  from  (a.4a)  we  have 

r(n)4»&(n)  =  lMn9m{n){h**N)tKn). 

Passage  to  the  limit  along  yields 


B(<p,v)  *  q<pfi  dx. 


(all) 


Hence  either  p  *  0,  or  y  is  an  eigenfunction  of  (a. 4)  with  corresponding  eigen- 


value  fim.  But  the  normalization  (a.Ba)  implies  that  ||y>||0  =  1.  and  the  lemma  is 
proven. 

In  preparation  for  the  proof  of  Lemma  4.1b  we  develop  some  additional 
results.  Consider  the  inhomogeneous  problem 

B(u,v)  =  fqfv  dx  forallue#m.  (a.l2a) 

For  any  /  e  Lz{ 0),  the  solution  u  of  (a.  12a)  is  in  &m,  Let  T:LZ  -*  denote  the 
solution  operator 

Tf  =  u.  (a.  12b) 

Similarly,  let  Tn:Sn  -*  Sn  defined  by 

Tnf  *  m  (a.  13a) 

denote  the  solution  operator  for  the  discrete  inhomogeneous  problem 

AV=  h^N?.  (a.  13b) 

Observe  that  while  (a.  13b)  is  stated  in  terms  of  the  vectors  U  and  F,  the  opera¬ 
tor  Tn  maps  the  function  /  to  the  function  u . 

Our  goal  is  a  discussion  of  the  relationship  of  the  spectra  of  these  opera¬ 
tors.  If  A  is  an  eigenvalue  of  (a.4b)  then  1/ A  is  am  eigenvalue  of  T\  similarly,  if  m 
is  an  eigenvalue  of  (a. 4a)  then  1/ fj.  is  an  eigenvalue  of  Tn  ■ 

Leuua  A.2.  Let  S  be  a  bounded  subset  of  the  resolvent  set  of  T  with 
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Let  *  €  S  and  let  /  e  5n.  Consider  the  inhomogeneous  problem 


A  U  -  -j- hZmNU  =  QF.  (a.  15) 

There  is  an  integer  n0  and  a  constant  K  depending  on  E.  but  not  on  n  or  / ,  such 
that  for  ninj  (a.  15)  has  a  unique  solution  u  e  Sn  and 

IM!o**ll/llo.  (a.16) 

(Note  once  more  that  we  pose  the  problem  in  terms  of  U  and  F  but  consider  the 
solution  as  a  function  u  e  Sn .) 

Proof.  Because  (a.  15)  is  a  linear  problem  and  Sn  is  a  finite-dimensional 
space,  the  lemma  follows  once  we  have  established  (a.  18).  Suppose  (a.  16)  is 
false.  Then  there  is  a  subsequence  (n'j  for  which  the  complex  number  2„CC 
and  the  functions  /  (n)  and  u(n)  €  Sn  that  are  related  by  (a.  15)  satisfy 

z„  -  eE.  ||u(n)||0=l.  \\f  (n)||0  -*  0.  (a.17) 

However,  from  (a.  15)  we  have 

Ut(n)AnU(n)  -  -l-U'<ji){h?*Nn)U(n)  =  U\n)QF{n). 
zn 


We  rewrite  this  to  get 


i?(u(n),u(n)) - —fq\u(n)\2±c  =  JfUdx  +  — en(u.u).  (a.18) 

zn 


Arguing  as  in  the  proof  of  Lemma  A.  1.  we  find  for  n'  large  enough  that 


ll«(n)llm  < 


211  g  II- 

*0 1  *  I  min 


+  2||/(n)||0. 
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Therefore  there  is  a  subsequence  jn"j  of  jn’j  and  a  function  if  e  so  that 
u{n")  -*  <p  weakly  ||p||0=l. 

Moreover,  (a.  17)  and  (a.  18)  imply  that  for  every  v  e  f}m  the  function  if  satisfies 

B{if,v)  =  -^—fqipV  dx. 

Hence  1  /  zm  is  an  eigenvalue  of  problem  (a. 4)  and  zm  is  an  eigenvalue  of  T.  But 
this  is  impossible. 

Lemma  A.  3.  Fix  g  e  Hm( 0)  and  let  g(n)  e  Sn  be  the  Lz  projection  of  g  onto 
Sn.  Let  E  be  as  above.  For  every  z  e  E,  let  u(x;z)  and  u(x;z,n)  be  the  solu¬ 
tions  of 


B{u,v)  — ^-fquiJ  dx  =  f  gU  dx  for  all  v  e  ftm. 


AU{z,n )  -  —hZmNU(z,n)  =  QGln). 

z 


(a.  19) 


Then 


||tt  (';z  ,n)||0  s  /follffllo- 


||ti(  ;z)  -  u(-;z,n)|j0 -*  0  as  n  -*  ». 

Proof,  For  each  n  we  have 

U'AU-  —Lr{hZmN)U-  U*QG{n). 
2 


(a. 20) 
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This  equation  may  be  rewritten  as 

B(u,u)  — —f  g  |  u  \zdx  -  JgU  dx  +  -~s„(u,u). 

Because  ||u|!0  is  uniformly  bounded,  the  usual  argument  shows  that 
u{  \z,n)  -»  u(  ;z)  weakly  in  Hm( f));  but  then  u{  \z  ,n)  -»  u{  ,z)  strongly  in  Z,2(0). 

Theorem  A. 4.  Let  a  =  1/ A  be  an  eigenvalue  of  T.  Let  5  >  0  be  chosen  so  small 
that  a  is  the  only  eigenvalue  of  T  inside  the  circle  about  a  of  radius  26,  and  this 
circle  lies  entirely  in  the  right  half  plane  Re  z  >  0.  Then  there  is  an  nj  so  that 
for  eachn  i  n1  there  is  an  eigenvalue  an  of  Tn  satisfying 

|  a  -  an  |  <5.  (a. 21a) 

Consequently  /u*  =  1/  an  satisfies 

Proof.  We  consider  the  two  projection  operators 

where  T  is  the  circle  r  =  {*eC:|z-o|=5{.  In  order  to  prove  the  theorem  we 
need  only  show  there  is  an  rij  such  that  for  all  n  &  n.j 

En  *  0.  (a. 23) 

Let  be  the  eigenfunction  associated  with  a.  Then 


oLpsqp  in  0,  bf<p  *  0  on  00  (0£j£m-l). 


(a.24) 


Equivalently, 


Moreover, 


The  function 


satisfies 
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aB(<p,v)  =  JqipVdx  forallve#"1. 


Etp  -  <p. 


u{  \z)  :=  (z  - 


(a.  25) 


(a.  26) 


(a.27a) 


Lu - —qu  -  —Lip  =  —^—qtp  in  0,  6.-u  =  0  on  90.  (a. 27b) 

z  z  za 


In  other  words,  for  every  v  e  /?”*  we  have 


B{u,v)  — ~  f  q{x)u{x\z)v{,z)dx  -  ~~~f  <19$  dx.  (a. 28) 


Let  g  (:n)  e  Sn  be  the  Lz  projection  of  g  tp  onto  Sn .  Let  u>(;n)  be  the  solution  of 


B{ w,v)  =  fqtpv  dx  for  all  v  e  5„.  (a. 29) 


Then  ^  satisfies 


(a.  30) 


Now  set 
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<p{  \n)  :=  Enw(  \n). 

Our  goal  is  to  show  that  there  is  an  ni  such  that  ?(-;n)  *■  0  whenever  n 
have 


Let 


rn)_1ti;  (\n)dx. 


v(-;z,n)  :=  (z  -  Tn)~lvj(-.n). 

A  straightforward  calculation  shows  that  V  satisfies 

AV  -  —[h2mN)V=  W  =  —  QG. 
z  x  zo 

Comparing  (a.28)  and  (a.34),  we  see  by  Lemma  A.3  that 

||v(  ;z ,n)!|0 i  K 

for  some  constant  K,  and 

||w(  ;z  ,n)  -  u(-;z)||0  -*  0. 

By  (a.22),  (a.26).  and  (a. 27a), 

moreover,  by  (a.31)  and  (a. 32) 

p(:*)  =  -gj^-^rv(;z,n)dz. 


(a.3l) 

We 

(a.  32) 

(a.  33) 

(a.34) 

7  a.  35a) 

(a.  35b) 

(a.  36a) 

(a.  36b) 


The  dominated  convergence  theorem  and  (a. 31)  now  imply  that 

IM-;n)  -  »>(  )llo  -*  0  asn-*«. 

But  <p  *  0;  hence  p(;n)  *  0  for  large  n,  and  the  theorem  is  proven. 

Remark.  Following  the  argument  in  [14],  one  can  give  a  complete  discussion 
of  the  relationship  of  the  eigenvalue  problem  (a. 4a)  to  the  eigenvalue  problem 
(a. 4b).  All  that  remains  for  completeness  is  to  establish  that  the  multiplicity  of 
eigenvalues  is  preserved.  However,  because  it  is  not  relevant  to  our  present 
purposes  we  omit  it. 
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